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Abstract 

We study and compare the Shannon capacity region and the stable throughput region for a random 
access system in which source nodes multicast their messages to multiple destination nodes. Under 
an erasure channel model which accounts for interference and allows for multipacket reception, we 
first characterize the Shannon capacity region. We then consider a queueing-theoretic formulation and 
characterize the stable throughput region for two different transmission policies: a retransmission policy 
and random linear coding. Our results indicate that for large blocklengths, the random linear coding 
policy provides a higher stable throughput than the retransmission policy. Furthermore, our results 
provide an example of a transmission policy for which the Shannon capacity region strictly outer bounds 
the stable throughput region, which contradicts an unproven conjecture that the Shannon capacity and 
stable throughput coincide for random access systems. 
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On the Shannon capacity and queueing 
stability of random access multicast 

I. Introduction 

A fundamental question of communication theory is: at what rate can information be trans- 
mitted reliably over a noisy channel? There is more than one way to go about answering this 
question. For instance, consider an erasure channel where the parameter e denotes the probability 
with which a transmission on the channel is lost; with probability 1— e the transmission is received 
without error. The traditional approach for describing the rate of reliable communication for the 
erasure channel is to cite its Shannon capacity, which is 1 — e bits per channel use for a channel 
with binary inputs and outputs. If feedback is available to notify the sender when a channel 
input is erased, then the capacity can be achieved by retransmitting lost inputs [1]. 

Alternatively, the rate of reliable communication can be described by the maximum stable 
throughput. In this setting, we view the channel input as a packet of fixed length that arrives at 
a random time to a sender and is stored in an infinite-capacity buffer while awaiting its turn to 
be sent over the channel. The packets in the buffer form a queue that is emptied in a specified 
order, traditionally in first-in-first-out (FIFO) order. A transmission protocol, for instance an 
Automatic Repeat Request (ARQ) protocol, provides a form of redundancy to ensure that the 
packet is received correctly. The maximum stable throughput is the highest rate (in packets per 
channel use) at which packets arrive to the sender while ensuring that the queue remains finite. 
In the case of the erasure channel, if we assume that packets arrive to the sender according to a 
Bernoulli process, feedback is available to notify the sender of lost packets, and the transmission 
protocol consists of retransmitting lost packets, then the buffer at the sender forms a discrete-time 
M/M/l queue with maximum departure rate 1 — e. The maximum stable throughput is 1 — e, 
which is identical to the Shannon capacity. 

For multiuser systems, the relation between the Shannon capacity and the maximum stable 
throughput for communication over an erasure channel has been explored in the context of ran- 
dom multiple access, where user n transmits with probability p n at each transmission opportunity. 
This form of random channel access is a variation on Abramson's ALOHA protocol [2] and is 



February 1, 2008 



DRAFT 



2 



particularly attractive for use in mobile ad-hoc networks because it is robust to variations in the 
network topology and can be implemented without coordination among the transmitting nodes. 

The finite-user, buffered random access problem was first formulated by Tsybakov and Mikhailov 
[3], who provided a sufficient condition for stability and thus a lower bound on the maximum 
stable throughput. The problem they considered was a system in which finitely many source nodes 
with infinite-capacity queues randomly access a shared channel to send messages to a central 
station. Feedback was used to notify the source nodes of failed transmissions and a retransmission 
scheme was used to ensure eventual successful reception at the central station. The users were 
assumed to access a collision channel, in which transmission by more than one source results in 
the loss of all transmitted packets with probability 1 . This collision channel model is equivalent 
to an erasure channel, where for user n, 1 — e = PnlLynU ~~ Pj)- Further progress on this 
problem was made in [4], in which stochastic dominance arguments were explicitly introduced 
to find the stable throughput region for a system with 2 source nodes, and in [5], wherein a stable 
throughput region based on the joint queue statistics was found for 3 source nodes. An exact 
stability result for arbitrarily (but finitely) many users has not been found, but bounds have been 
obtained in [5] and [6]. Recently, the authors of [7] improved upon the collision channel model 
used in all previous works and studied a channel with multipacket reception (MPR) capability. 
They showed that the stable throughput region transfers from a non-convex region under the 
collision channel model to a convex region bounded by straight lines for a channel with MPR. 

The Shannon capacity region of a random access system was considered in [8] and [9], which 
both obtained the capacity region for finitely many source nodes transmitting to a central station 
under the collision channel model. That capacity result can be viewed as the capacity of an 
asynchronous multiple access channel, which was obtained in [10] and [11]. The more recent 
contribution of [12] shows explicitly how the random access capacity region in [8], [9] is obtained 
from the results in [10], [11], in addition to analyzing the capacity for a channel in which packets 
involved in a collision can be recovered. 

It was noted by Massey and Mathys [8] and Rao and Ephremides [4] that the stable throughput 
and Shannon capacity regions coincide for the special cases of two source nodes and infinitely- 
many source nodes. As with the point-to-point erasure channel, this result is surprising in that it 
suggests that the bursty nature of arriving packets, which is captured in the stability problem but 
not in the capacity problem, is immaterial in determining the limits on the rate of reliable 



February 1, 2008 



DRAFT 



3 



communication. It has been conjectured that the stable throughput region for finitely-many 
source nodes transmitting to a central station (which is an unsolved problem) coincides with 
the corresponding capacity region. This conjecture was explored in [13], in which it was shown 
to hold in a special case involving correlated arrivals of packets at the source nodes. Recently, 
further progress was made in [14] towards showing that the stable throughput and Shannon 
capacity regions coincide for transmission over a channel with MPR. However, a complete 
proof has still not been found. 

In this work we explore the relation between the stable throughput and Shannon capacity for 
a random access system in which source nodes multicast their messages to multiple receivers. 
Specifically, we consider a system with two source nodes and two destination nodes. The source 
nodes randomly access the channel to transmit to the two destination nodes. We first characterize 
the Shannon capacity region of the system, which is similar to Ahlswede's result [15] on the 
capacity for two senders and two receivers. We then move to the queueing stability problem 
and characterize the stable throughput region for our random access multicast system with two 
different transmission policies. The first is a retransmission policy, which is the policy used 
in previous works on queueing stability for a (single) central station. Next, we study random 
access multicast with random linear coding, which is inspired by the recent development of 
network coding [16], [17] and fountain coding [18], [19]. Our results show that for multicast 
transmission, the maximum stable throughput under the retransmission policy does not reach 
the Shannon capacity, however, the random linear coding scheme provides a maximum stable 
throughput that asymptotically approaches the Shannon capacity. 

II. System model 

The system we consider throughout this work is shown in Fig. [T] Two source nodes, indexed 
by n, each generate messages to be multicast to two destination nodes, indexed by m, over a 
shared channel. The data generated at source n — 1 is assumed independent of the data generated 
at source n = 2. Time is slotted; one time slot corresponds to the amount of time needed to 
transmit a single packet over the shared channel. A packet is a fixed-length vector of bits. In each 
time slot, if source n has a packet to transmit, then we refer to the source as being backlogged; 
otherwise the source is empty. A backlogged source transmits in a slot with probability p n . We 
refer to p n as the transmission probability; it encapsulates random access to the channel. We 
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Fig. 1. The multicast scenario we consider in this work. Two source nodes randomly access the channel to multicast to two 
destination nodes. When both sources transmit, which happens in a slot with probability P1P2, the reception probabilities are as 
shown above. 



assume the value of p n to be fixed in time. (I.e., we do not assume retransmission control, in 
which p n is varied over time according to the history of successful transmissions.) 

The channel model we consider is similar to the model used in [7]. A transmitted packet is 
received without error with a certain probability. Otherwise, the packet is lost and cannot be 
recovered. We assume that the channels between different source-destination pairs are indepen- 
dent. We introduce the following reception probabilities for sources n — 1, 2 and destinations 
m = 1,2. 

#n|n = Prjpacket from n is received at m\ only n transmits} (1) 

q^ 2 = Pr{p ac ket from n is received at m| both sources transmit} (2) 

We assume throughout that interference cannot increase the reception probability on the channel, 
i.e., > q^H 2 - The reception probabilities inherently account for interference and also allow 
for multipacket reception (MPR). Note that these probabilities can capture the effects of fading 
on the wireless channel by setting them equal to the probability that a fading signal, represented 
by a random variable, exceeds a certain signal to interference plus noise (SINR) threshold. The 
collision channel model used in a number of previous works is given by q^$ = 1, q£u 2 = ®- 

III. Shannon capacity region 

We first analyze the system under consideration in an information-theoretic framework to 
determine the Shannon capacity region. Thus we assume in this section that the sources are 
always backlogged. Coding is performed on the data at the source nodes, and we view each 
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transmitted packet as a codeword symbol, where a collection of N codeword symbols constitutes 
a codeword. In order to allow for random access of the channel, we assume that while codeword 
symbols are synchronized (equivalently, time is slotted), the codewords for the two sources do 
not necessarily begin and end in the same time slots. We analyze this system first for a general 
discrete memoryless channel (DMC) and then apply our random access channel model to obtain 
the capacity region. 

A. Discrete memoryless channel 

The discrete memoryless channel we consider consists of discrete alphabets Xi,X 2 ,y±, and 
y 2 and transition probability matrix W(yi, 2/2^1, ^2)- The channel can be decomposed into two 
multiple access channels, each corresponding to a destination node and defined as follows. 

Wi(yi\x 1 ,x 2 ) = ^2 W(yi,y 2 \xi,x 2 ) (3) 

W 2 (y 2 \x u x 2 ) = W(yi,y 2 \xi,x 2 ) (4) 

yieVi 

We assume that there is no feedback available on the channel, which differs from the assumption 
made in the model for the stable throughput problem presented in Section [IV] 

Source node n generates a sequence of messages J*, ■ ■ ■ where the t th message J* takes val- 
ues from the message set {1, 2, ... , 2 NRn }. The messages are chosen uniformly from {1,2,..., 2 NRn } 
and independently over n. The encoding function f n at source n is given by the mapping 

f n :{l,2,...,2 NR »}^X?, n = l,2. (5) 

The encoder output consists of a sequence of codewords X n (J^), t > 1. The system is asyn- 
chronous in the following sense. Each source and each destination maintain a clock. Let S nm 
denote the amount of time that the clock at source n is running ahead of the clock at destination 
m. The S nm are assumed to be integers, meaning that time is discrete and transmissions are 
symbol-synchronous. The time at each clock can be divided into periods of length N corre- 
sponding to the length of a codeword. Let D nm denote the offset between the start of periods at 
source n and destination m, where < D nm < N — 1. We assume that D nm are uniform over 
[0, 1, . . . , N — 1] for all N. The codeword X n ( J*) is sent at time on the clock at source n. 

A sequence of channel outputs are observed at each destination, where the outputs at destina- 
tion m each take values from the alphabet y m . The decoder operates on a sequence of N(T+1) 
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channel outputs to form an estimate of a sequence of T + 1 messages. A decoder is defined as 
follows. 

0n m :^ (T+1) -{l,2,...,2^} r+1 , n,ro = l,2 (6) 

where {1, 2, . . . , 2 NRn } T+1 denotes the (T + l)-fold Cartesian product of {1, 2, . . . , 2^"}. 
Since the decoder must synchronize on a particular source n, the decoding function is defined 
separately for each source. The output of the decoder is a sequence of message estimates 
Jnmi Jnrm • • • ? Jnm 1 ' where J* m denotes the estimate at destination m of the t th message sent 
by source n. The error criterion we consider is the average probability of error P e * defined as 

P e=vA{j{j{Jl^Jln}\- (V) 
\ m n ) 

The rate pair (Rx,R 2 ) is achievable if there exists encoding functions (fi,f 2 ) and decoding 
functions ((j>n, 0i2> 02i> ^22) such that P e * — > for all t as iV — > 00. The capacity region is the 
set of all achievable rate pairs 

The model we consider here is a compound version of the totally asynchronous multiple access 
channel treated in [10] and [11]. As shown in those works, the asynchrony in the system results 
in the lack of a convex hull operation, and this holds as well in our compound version of the 
problem. The capacity region is presented below and the proof of the theorem is described in 
Appendix HI 

Theorem 1: The capacity region of the asynchronous compound multiple access channel is 
the closure of all rate points (R 1 , R 2 ) that lie in the region 

R-y < I{X x -Y m \X 2 )\ 

(Ri,R 2 ): R2 < I{X2,Y m \Xi) 



n 



R, + R 2 < I{X x ,X 2 ;Y n 
for some product distribution P(xi)P{x 2 )W . 



B. Random access system 

We now turn our attention to a random access system and apply Theorem Q] to determine the 
capacity region of the system. Each codeword symbol corresponds to a packet transmitted over 
the channel shown in Figure [IJ We define the common input alphabet as X — {0, 1, 2, ... , 2"}, 
where X n G X, for n = 1,2. A channel input X n can be either a packet of length u bits (an 
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information-bearing symbol) or an idle symbol. The symbol is the idle symbol and we let 
Pr{X„ = 0} = 1 — p n according to the random access transmission probability. We assume 
a uniform distribution on the information-bearing codeword symbols, Pr{X n = x} = p n /2 u , 
x = 1,2,... 2", meaning that a packet is equally likely to be any sequence of u bits. The 
channel output at receiver m is given by Y m = (Y\ m , Y 2m ) G X' x X' where Y nm denotes the 
packet from source n and X' = X U A. The A symbol denotes a packet in error. 

The introduction of the idle symbol results in additional protocol or timing information being 
transmitted over the channel. The information content of this idle symbol is h b (p n ),n = 1,2, 
where h b denotes the binary entropy function. The term h b (p n ) appears in the proof provided 
below and represents the protocol information that is studied by Gallager in [20]. Because we 
would like our capacity result to represent the rate of reliable communication of data packets, 
we will aim to exclude this timing information. We do so by considering capacity in packets/slot 
in the limit as u — > oo, meaning that the data packets grow large and the fraction of timing 
information transmitted approaches 0. The timing information is excluded in previous work 
on random access capacity. In [8], prior to the start of transmission, a "protocol sequence" 
indicating the occurrence of idle slots is generated at the source and communicated to the receiver, 
effectively eliminating timing information. In [12], the capacity for u — > oo is presented. The 
capacity of the random access multicast system is given in the following Corollary to Theorem 

m 

Corollary 2: The capacity region of the random access system with two sources and two 
destinations is the closure of (Ri,R 2 ) for which 

r> ^ ■ l 1 \ ( m ) i ( m ) 

Rl < ^W 1 ^ -P2)q 1 \ 1 +PlP2?i|i, 2 

for some (pi,p2) G [0, l] 2 . 

Proof: The result follows by applying the assumptions about the input distribution and chan- 
nel reception probabilities to the expressions given in TheoremQ] We first solve for I(Xi, Y m \X 2 ) 
by conditioning on X 2 to obtain 

I(X i; Y m \X 2 ) = (1 -p 2 )/(X i; y m pf 2 = 0) +p 2 I(X 1 ;Y m \X 2 ^ 0). (8) 



February 1, 2008 



DRAFT 



An expression for I(Xi, Y m \X 2 = 0) can be found from the following sequence of equalities. 

I(X 1 ;Y m \X 2 = 0) = H(X 1 \X 2 = 0)-H(X 1 \Y m ,X 2 = 0) 



( = } H(X 1 )-Pr(Y lm = A|X 2 = 0)log 2 2" 



-(1 - px) log 2 (l - pi) - pi log 2 (pi/2 B ) - pi(l - 



(m) 



= h(pi) + Piq^u (9) 

where (a) holds since X 2 is independent of X\ and since H{X\\Y\ m ^ A,X 2 = 0) = 0. For 
(X i; y m |X 2 ^0) we have 

j(x i; y m |x 2 ^o) = F(x 1 |x 2 ^o)-^(x 1 |y m ,x 2 ^o) 

= H{X X ) - Pr(F lm = A|X 2 + 0) log 2 2" 
= -(1 - Pi) log 2 (l - Pi) - Pi log 2 (pi/2 u ) - pi(l - q{u 2 )u 



h(Pi) + Pi log 2 2 u -p 1 u + Piq^l] 2 u 



= h b (pi) +Piq ( ^] 2 u. (10) 
Combining expressions © and (flOl) results in 

J(X i; y m |X 2 ) = Vpi) + u Pl (l - p 2 )g^ + 

wpiP2?^2 bits/transmission. (11) 

Since one packet corresponds to u bits, we divide by u to obtain a result in units of packets per 
slot. We then let u — ► oo to obtain 

J(Xl; F m |X 2 ) =pi(l- p 2 )g{™ } + Pi^g^ P a ckets/slot. (12) 
By following a similar approach, we can show that I(X 2 ; Y m \Xi) is given as follows. 

I{X 2 ; Y m \Xi) = (1 - Pi)p 2 q { 2 ™ 2 + PiP2g 2 ^ 2 packets/slot (13) 

The bound on the sum rate can be found by breaking up I(X X , X 2 ; Y m ) into four terms. 

I(X 1 ,X 2 ;Y m ) = H(X 1 ,X 2 )-H(X 1 ,X 2 \Y m ) 

= H(X 1 \X 2 ) + H(X 2 ) - H(X 1 \Y rtl} X 2 ) - H(X 2 \Y m ) 

= H(X 1 )+H(X 2 )-H(X 1 \Y lm ,X 2 )-H(X 2 \Y lm ,Y 2m ) (14) 
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For n — 1, 2, the terms H(X n ) can be expressed as 

if(X n ) = -(1- Pn )l0g 2 (l-Pn)-Pnl0g 2 b„/2 M ) 
= MP") +P„log 2 2 U 

= h b (p n )+p n u. (15) 
The last two terms in (fT4j) can be found in the following manner. 

H(X 1 \Y lm ,X 2 ) = H(X 1 \Y lm = A,X 2 )Pr(Y lm = A\X 2 ) 

= (1 -p 2 )H(X 1 \Y lm = A,X 2 = 0)Pr(F lm = A|X 2 = 0) 

+p 2 #(X 1 |r lm = A,X 2 ^ 0)Pr(Y lm = A|X 2 ^ 0) 
= (1 - pa) log 2 2"Pr(F lm = A|X 2 = 0) + p 2 log 2 2 u Pr(F lm = A|X 2 ^ 0) 
= u(l - p 2 )pi(l - q^) + wp 2 pi(l - q^l] 2 ) 

= upi -upi(l- p 2 )q { ^ - upip 2 q[™] 2 (16) 

H(X 2 \Y lm ,Y 2m ) = (l-p 1 )H(X 2 \Y lm = 0,Y 2m )+p 1 H(X 2 \Y lm ^0,Y 2m ) 
= (1 - Pl )H(X 2 \Y lm = 0, F 2m = A)Pr(F 2m = A\Y lm = 0) 

+ Pl H(X 2 \Y lm ^ 0, F 2m = A)Pr(F 2m = A\Y lm ^ 0) 
= (1 - ft) log 2 2> 2 (1 - g^) + Pl log 2 2> 2 (1 - g^ 2 ) 

/1 \ ( m ) ( m ) /n\ 

= Up 2 - U{1 - P\)P2q 2 \ 2 ~ «PlP2<?2|l,2 ( 17 ) 

By substituting (fl"5l) . (fl6l) . and (flTl) in (fl"4l) . dividing by w and taking u — > oo, we obtain 

X 2 ; F m ) = pi(l - p 2 )gl]i ) + PiP2?i^ 2 + ( X _ Pi)*^]? + PiP2<?2|i?2 packets/slot. (18) 

Since /(A^, A" 2 ; F m ) = F m |X 2 ) + I(X 2 ; Y m \Xi), the bound on the sum rate is superfluous 

in terms of describing the capacity region. The result follows. ■ 

IV. Stable throughput region 

In this section we treat the system shown in Fig. [Das a network of queues and state the stable 
throughput region of the system, which is a generalization of previous results on the stable 
throughput for a system with a single destination node. The model we consider is as follows. 
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We no longer assume that the sources are always backlogged; instead a random Bernoulli process 
with rate A n packets/slot, n = 1,2 models the arrival of packets at each source. Packets that 
are not immediately transmitted are stored in an infinite-capacity buffer maintained at each 
source. Transmissions occur according to the random access protocol with source n transmitting 
with probability p n when it is backlogged. If a source is empty in a given slot, it does not 
access the channel. Each source-destination pair is assumed to maintain an orthogonal feedback 
channel so that instantaneous and error-free acknowledgements can be sent from the destinations 
to the sources. We find the stable throughput region for two different transmission schemes: 
retransmissions and random linear coding. 

The queue at each source is described by its arrival process and departure process. As A n 
represents the arrival rate, we let \i n denote the departure or service rate. In general, a queue is 
said to be stable if departures occur more frequently than arrivals, i.e., A n < /i n . This statement 
is made precise by Loynes' result [21], which states that if the arrival and departure processes are 
non-negative, finite, and strictly stationary, then A n < p, n is a necessary and sufficient condition 
for stability. Stability of the queue is equivalent to ergodicity of the Markov chain representing 
the queue length. The stable throughput region for a given transmission policy is defined as the 
set of all (Ai, A 2 ) for which there exists transmission probabilities (p\,P2) such that both queues 
remain stable. 

The difficulty in finding the stable throughput region for our system (and for any buffered 
random access system) arises from the interaction of the queues. In particular, the service rate 
fi n of source n will vary according to whether the other source is empty or backlogged and can 
create interference on the channel. To overcome this difficulty, the technique provided in [4] of 
introducing a dominant system can be used to decouple the sources. In a dominant system, one 
of the sources behaves as if it is always backlogged by transmitting "dummy" packets when it 
empties. The queue length in a dominant system stochastically dominates (i.e., is never smaller 
than) the queue length in the system of interest, meaning that stability in a dominant system 
implies stability in the original system. Since one source always behaves as if it is backlogged, 
the service rate in the dominant system can be easily found. Let [i n \, denote the service rate at 
source n when the other source is backlogged and p, ne the service rate when the other source 
is empty. Using the dominant systems approach, the stable throughput region for a system with 
two sources can be found exactly. This region is stated in the following theorem, which is a 
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generalization of the result in [4]. Note that in the stable throughput region presented below, the 
service rates fx n b and [i ne are functions of p n , n = 1,2 (although not explicitly shown in these 
expressions). 

Theorem 3: [4] For a network with two sources and two destinations, the stable throughput 
region is given by the closure of £(pi,p 2 ) where 

C( Pl ,p 2 ) = |J C t (p uP2 ) (19) 

t=l,2 

and 

A(Pi,P2) = I (Ai,A 2 ) : Al 
I A 2 

r a, 

£ 2 (pi,p 2 ) = < (Ai, A 2 ) : ^ 

for some (pi,p 2 ) £ [0, l] 2 . 

In addition to the stable throughput region, we will be interested in the throughput region of 
the random access system shown in Fig. [TJ The throughput region is the closure of the service 
rates /i n6 for all p n , n = 1,2, where both sources are assumed to be backlogged. In finding the 
throughput region, there is no interaction between the sources, and the problem is simpler than 
finding the stable throughput problem. Previous work on buffered random access systems has 
shown that in all cases in which the stable throughput region has been found, it is known to 
coincide with the throughput region, suggesting that the empty state of the buffer is insignificant 
in determining stability. The relation between stable throughput and throughput is explored in 
[14]. Additionally, in [22], it is proved that for a random access system with two sources and 
two destinations, the stable throughput region coincides with the throughput region. This result 
is restated below. 

Theorem 4: [22] The stable throughput region of the random access system with two sources 
and two destinations is equivalent to the throughput region, which is given by the closure of 
(Ai, A 2 ) for which 

Al < /ilfe, A 2 < p,2b 

for some (p\,p 2 ) £ [0, l] 2 . 



< fJ>lb 

H>2b 

< H2b 

< H\b 

< A*26 

A*16 



A2_ 

^2b 



fJ>u 



Ai_ 

fJ>u 



f^2e 
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We derive the backlogged and empty service rates fx n b and \x ne for two different transmission 
schemes. Together with Theorems [3] and @] this provides us a complete characterization of the 
stable throughput region. 

V. Stable throughput: retransmissions 

In this section we describe the stable throughput region under assuming that a retransmission 
protocol is used to ensure reliable communication. In the retransmission scheme, as long as 
source n has not received feedback acknowledgements from both destinations m = 1, 2, it will 
continue to transmit the packet over the channel with probability p n in each slot. As soon as the 
source has received acknowledgements from both destinations, it will remove the packet from 
its queue and begin transmitting the next packet waiting in its buffer, if any. Let random variable 
T n denote the service time for source n, given by the total number of slots that transpire before 
the packet from source n is successfully received at both destinations. (Note that the service 
time includes slots during which the source does not transmit, which happens with probability 
1 — p n ). Since each completed service in the retransmission scheme results in 1 packet being 
removed from the queue, the average service rate is given by fi n = l/E[T n }. 

We first find the backlogged service rates n nb . Let denote the number of slots needed 
for successful reception of a packet from source n at destination m, m = 1,2. The Ti m) are 
geometrically distributed according to the transmission probabilities p n and reception probabili- 
ti es Qn\l ' Qn\i2- We introduce the following notation. Let <p n denote the probability of successful 
reception of the packet from source n at destination 1 given that source n transmits and that 
both sources are backlogged. Similarly, a n denotes the probability of successful reception at 
destination 2 given that both sources are backlogged and that source n transmits. For instance, 
0i and <7i are given by 

01 = P2?!|l + P2?i| 1)2 (20) 

a l = P2?i|l + P2?l|l, a (21) 

where p n = l—p n . When source 2 is backlogged, Tf^ is geometrically distributed with parameter 

(2) 

and 7\ is geometrically distributed with parameter p\0\. The total service time for source 
1 when source 2 is backlogged will be given by the maximum of the service times to each 
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destination, 



Ti~maxT 1 M . (22) 



Similarly, when source 1 is backlogged, the service time for source 2 is given by 

T 2 ~maxT 2 (m) , (23) 

m 

where 

T 2 (1) ~ geom (p 2 2 ) , T 2 (2) ~ geom (p 2 a 2 ) . (24) 

The expected maximum value E[T n ] can be readily found and the backlogged service rates are 
given by 

Pn<fin(Tn{4>n + On ~ T n ) 
{<Pn + Vn){<Pn + CT n - T n ) - <p n O n 

where r n denotes the probability that a packet sent from n is received at both destinations given 

*U 4- 4V - (!) ( 2 ) , (!) ( 2 ) 

that source n transmits, e.g., t x = P29iii9i|i + P2^i|i 2^i|i 2- 

The empty service rates /x ne can be found directly from /i nb as 

H>\e = /ilb|p 2 =0; /^2e = A t 2b|pi=0- (26) 

The backlogged and empty service rates for random access multicast with retransmissions have 
also been found in [22]. In that work, a different approach is used in which a Markov chain 
is used to model which destinations have received the packet currently under transmission. The 
result is identical to the one presented above. 

We now compare the stable throughput region for the retransmissions scheme to the Shannon 
capacity region. We consider the backlogged service rate /x n &, since, by Theorem HI this is the 
term that bounds the stable throughput for source n. The expected service time for source 1 
when source 2 is backlogged is bounded as 

E[T X ] = E[maxT 1 (m) ] > max E[T[ m) ] (27) 

m m 

(6) 1 , OQ , 

= max 1—. 1—- (28) 

m /I \ ( m ) i ( m ) 

Pl(l -P2)q{\i +PlP2Qi\l,2 

= ~n rr- ( 29 ) 

/i \ ( m ) i ( m ) 
mm m j9i(l -p 2 )q\\ l +PiP29i|i, 2 
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where (a) follows from Jensen's inequality and (b) follows from the expected value of a 
geometrically distributed random variable. Then the backlogged service rate fin, is bounded 
as 

fin = ^rpTj < miapi(l - P2)q ( $ + PiP2q^ 2 (30) 

and fi2b can be bounded similarly. Note that the right-hand side of (|3Q|) is equal to the bound on 
the Shannon achievable rate R\ given in Corollary |2] Thus we should expect that the Shannon 
capacity region outer bounds the stable throughput region for the retransmission scheme. 

VI. Stable throughput: random linear coding 

In this section we present two different approaches to analyzing the stable throughput region 
for a transmission scheme in which groups of K packets at the front of the queue are randomly 
encoded and transmitted over the channel. By encoded, we mean that a random linear combina- 
tion of the K packets is formed, and we refer to this random linear combination as a coded packet. 
As soon as a destination has received enough coded packets and is able to decode the original 
K packets, it does so and sends an acknowledgement to the source over its feedback channel. 
Once the source receives acknowledgements from both destinations, it removes the K packets 
it has been encoding and transmitting from its queue and begins encoding and transmission of 
the next K packets waiting in its buffer. The stable throughput region for a similar system with 
K = 2 is found in [23]. 

For a given source, let si, s 2 , . . . , sk denote the K (binary) packets at the front of the queue. 
Random linear coding is performed in the following manner. A coded packet is randomly 
generated as 

K 

^a-iSi (31) 

i=l 

where the coefficients a« are generated according to Pr(aj = 1) = 1 — Pr(aj = 0) = 1/2, 
i = 1, 2, . . . , K, and Yl denotes modulo-2 addition. A coded packet formed in this way is the 
same length as one of the original packets Sj and can be transmitted over the channel within the 
same time period of a slot. For each coded packet sent, the coefficients a* used in generating the 
packet will be appended to the header of the packet. In each slot, the source generates a coded 
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packet according to (13TI) and sends it over the channel. Regardless of whether a previously- 
generated coded packet has been received, the source generates a new coded packet in each slot 
and transmits it with probability p n . 

A. Expected service time 

We first analyze the random linear coding scheme by examining the expected service time in a 
manner similar to the approach used for the retransmission scheme in Section |V] Let T n denote 
the service time for source n, which is the number of slots that elapse from the transmission of 
the first coded packet until the source has received acknowledgements from both destinations. 
Since each completed service in the random linear coding scheme results in K packets being 
removed from the queue, the average service rate is given by ju n = K/E[T n ]. 

The service time will be a random variable dependent upon the random access transmission 
probabilities p n , the reception probabilities and ?„^ 2 ' an( * me num ber of coded packets 
needed to decode. Let ivl" 1 ' denote the number of coded packets received from source n at 
destination m before destination m can decode the original K packets. The Nn will be 
identically distributed over n and m since all coded packets are generated in the same way 
according to (13TI) . Additionally, N^ 1 will be independent over n since the two sources generate 
their coded packets independently. However, will be correlated over m, since a given 

source n will generate and transmit the same coded packets to both destinations m = 1,2. 

For a fixed value of K, let Fk{j) denote the common cumulative distribution function (cdf) 
of N^, or the probability that the number of coded packets needed for decoding is less than or 
equal to j. With each coded packet it receives, the destination collects a binary column of length 
K in a matrix, where the column consists of the coefficients a», i = 1, 2, . . . , K. Then Fk{j) 
is the probability that decoding can be performed (by solving a system of linear equations, or 
equivalently, by Gaussian elimination) if the matrix has at most j columns. Thus 



Note that for j < K the matrix cannot possibly have rank K and Fx{j) = 0. For j > K, we can 
write an expression for Fx(j) following the procedure in [24] by first counting up the number 
of K x j non-singular matrices, which is given by 



FkU) = Pr{ a random Kxj binary matrix has rank K}. 



(32) 



(2 j - l)(2 j - 2)(2 j - 2 2 ) . . . (2 j - 2 K ~ 1 ). 



(33) 
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In the product above, each term accounts for a row of the K x j binary matrix and reflects that 
the row is neither zero, nor equal to any of the previous rows, nor equal to any linear combination 
of previous rows. Since the total number of K x j binary matrices is 2 jir , we obtain 



FkU) = { (34) 




The probability mass function (pmf) of Nn U \ or the probability that decoding can be performed 
when the destination has received exactly j columns and no fewer, is given by 

f K {j) = F K {j)-F K {j-l). (35) 

From (|34|) and (1351) the expected value of can be computed, where E[Nn ] > K. The 



ratio 



E[Ni m) ] 

i=0 j=K+l \ i=0 i=0 



n a - 2- K+i ) + ^ e 4 n (! - 2 ~ j+i ) - n ^ - 2_i+i+i ) (36) 

j=K+l \ i=0 i=0 J 

as K — > oo (37) 



for all n, m = 1, 2. 

With the distribution of iV„ characterized, we can now describe the service time from 
source n to destination m, which we denote . The number of slots needed for the successful 
reception of each coded packet will be geometrically distributed and in total Nn coded packets 
must be received. Then can be modeled as the sum of Nn independent geometrically 
distributed random variables. 

qr>{m) _ _M , (m) (m) n o>. 

1 n — 9n,l + 9n,2 + ■ ■ ■+ 9 M (m) (POJ 

In the above expression, g^f, i = 1,2, ... ,Nn , will be geometrically distributed with a 
parameter that depends on the reception probabilities and on the assumption of whether the 
other source is backlogged. For instance, when source 2 is backlogged 

g™ ~ geom (v x {l - p 2 )q^> + Pl p 2 q^ 2 ) , i = 1, 2, . . . , N™ (39) 

and when source 2 is empty, 

g™ ~ geom ( Pl q^) , i = 1, 2, . . . , . (40) 
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The total service time is given as 

f n = maxTi m) . (41) 

m 

As in the case of random access with retransmissions, we argue that the stable throughput 
region for random access with random linear coding will be outer bounded by the Shannon 
capacity region. In the case that source 2 is backlogged, the expected service time for source 1 
is now bounded as 

E[Ty] = E[maxf} m) ] > maxE[T} m) ] (42) 

m m 

(<>) E[Ni m) ] fA ~ 
= max r— p r- (43) 

m pi ( i - P2 ) q% + vm g|™ 2 

(c) E[N^} 



/-, \ (m) (m) 

mm m pi(l -p2)qW + pmqi\ 12 



(44) 



,( m ) 



where (a) again follows from Jensen's inequality, (b) holds since gfl are independent, identically 
distributed, and (c) holds since ivj m ' ) is identically distributed over m, meaning that -E^ivf^] = 

(2) ~ 

E[N{ '}. The backlogged service rate fiu is bounded as 

< rmnpi(l -p 2 )gi™ ) +PiP2g^ 2 - ( 46 ) 

Then the Shannon capacity region outer bounds the stable throughput region for random access 
with random linear coding. 

Unfortunately a difficulty arises in finding the service rates // n & and [i ne in closed form from 
E[max m Tn m ^]. This difficulty arises for a number of reasons: Tn and are not independent, 
and Tn is distributed according to a composite distribution function, for which the pdf is 
not easily expressed in closed form. In fact, even if these two difficulties were to be removed, 
E[max m Tn m ^} cannot be easily handled. For instance, let us assume that and Tn are 
independent and that = are deterministic (which means that the pdf is no longer 

composite). In that case, Ti m) is the sum of rv- m > iid geometric random variables, meaning 
that Tn follows a negative binomial distribution. Let us further make the assumption that 
1n\n = 1n\n anc ^ ^n\i 2 = Qn\i 2' wn i cn means that are identically distributed over m. In 
this very simplified case, E[ma,x m T^ 1 ] is the expected maximum of two iid negative binomial 
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random variables. The computation of this expected value is treated in [25], and the result 
involves a periodic function which is approximated by a Fourier series. Thus, even in this very 
simplified case, we can at best approximate E[max m Tn ], and this approximation must be 
computed numerically. 

B. Markov chain approach 

As an alternative to the analysis presented above, we now develop a Markov chain model 
which allows us to find the queueing service rates. For a given source node, we set up a vector 
Markov chain with state (i,j,k) corresponding to the number of linearly independent coded 
packets that have been received from the source node. In this model, i represents the number of 
linearly independent coded packets that have been received at destination 1 , and j represents the 
number of linearly independent packets that have been received at destination 2. Since the coded 
packets are generated by the same source, some of the coded packets received at destination 
1 may also have been received at destination 2, and k represents the number of such packets, 
where k < min(i,j). The variable k allows us to track the correlation between Nn and Nn\ 
which was a difficulty in our previous approach described above. The Markov chain evolves in 
discrete time over the time slots in our system model. 

The state space of the Markov chain is the three-dimensional discrete set of points [0, K] 3 . 
There are K+l absorbing states given by (K, K, k), < k < K, which represent the reception 
of K linearly independent coded packets at both destinations, for which the service of K packets 
at the source has been completed. Transitions in the Markov chain can only occur "upward", 
corresponding to the reception of a new linearly independent packet, and a transition results in 
an increase of the indices i, j, k by at most 1, meaning that at most 1 new linearly independent 
packet can be received in a slot. We use the notation {i\,ji,kx) — > (^2,^2,^2) to denote the 
transition from state (ii,ji,ki) to state (12^2^2)- 

The Markov chain is irreducible and aperiodic, and because it has a finite state space, a 
stationary distribution exists. Let n i>3 denote the steady-state probability of (i, j, k). The steady- 
state probabilities are found by solving the set of equations 




(47) 
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and 

*U,k = !■ (48) 

The service rate Jl n is equal to K times the probability of transitioning into an absorbing state 
(K, K, k), < k < K. There are only a few ways to transition into an absorbing state; let Ak 
denote the set of states which have a one-step transition into the absorbing state (K, K, k). For 

k e [0, K - 1] we have 

A k = {(K-l, K, h), (K-l, K, k-1), (K, K-l, k), (K, K-l, k-1), (K-l, K-l, k-1)} , 

(49) 

and for k = K, 

A K = {(K-1,K,K-1),(K,K-1,K-1),(K-1,K-1,K-1)}. (50) 

Note that we define Ak in this way since the states (K — 1, K, K) and (K, K — 1, K) violate 
k < min(i, j). The service rate for source n is given by 

K 

^n = KY, Yl ^ >k Pr((i,j,k)^(K,K,k)). (51) 

k=0 (i,j,k)€A k 

The transition probabilities (ii,ji,kx) — > (^2,^2,^2) for source n can be written assuming that 

the other source is either backlogged or empty, leading to the service rates Jl nb and Jl ne . 

As an example, consider the transition (i, j, k) — > + k) in the Markov chain for source 1 

when source two is backlogged. Assume first that source two does not transmit, which happens 

with probability 1 — p 2 . Then there are two ways for the transition (i,j,k) — > (i + l,j,k) to 

(2) 

occur. First, destination 2 could receive no packet, which happens with probability 1 — q^, 
while destination 1 receives a coded packet which is neither an all-zero packet nor equal to 
any linear combination of the i packets it has already received, which happens with probability 
q^l(l — 2 l 2~ K ). Alternatively, both destinations could receive a coded packet, but that packet is 
either the all zero packet or some linear combination of the packets that have been received by 
destination 2 and not by destination 1. This happens with probability g[|]g|^(2-' — 2 fc )2~ x . The 
same two alternatives are possible in the case that source 2 does transmit, which happens with 
probability p 2 , except that the reception probabilities are now given by qw 2 * Then the transition 
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Source 1 rate 



Fig. 2. Closure of the stable throughput and capacity regions for a channel with reception probabilities — q^l — 0.8, 
= q£X = 0.7, and gj™' 2 = Q^li^ = 0.6, m = 1,2. The stable throughput region for random linear coding is abbreviated 
RLC. 



k) — > (i + 1, j, k) for source 1 when source 2 is backlogged occurs with probability 



Pi 



(52) 



The same transition probability can be used when source 2 is empty by setting p 2 = 0. Similar 
arguments can be used to find all transition probabilities for our Markov chain model; we 
have stated those probabilities in Appendix HO Ultimately, we would like to find closed-form 
expressions for the service rates and Ji ne , but due to the size of the state-space, this is a 
difficult task. Instead we have computed some numerical examples based on the Markov chain 
model presented above, and those are presented next. 

VII. Numerical examples 

We have computed a number of numerical examples of the Shannon capacity region and the 
stable throughput regions for retransmissions and random linear coding. The results for random 
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linear coding have been computed with the service rates given by Equation (|5D) . Fig. |2] shows 
results for a "good" channel with relatively large reception probabilities while Fig. [3] shows 
results for a "poor" channel with smaller reception probabilities. In both figures, we have plotted 
the stable throughput for random linear coding (abbreviated "RLC") with various values of K. 
The results show that the Shannon capacity region is strictly larger than the stable throughput 
regions for both the retransmissions and random linear coding schemes. Additionally, the stable 
throughput region for random linear coding grows with K and appears to approach the capacity 
as K — > oo. 

The random linear coding scheme does not necessarily outperform the retransmission scheme. 
For small values of K, the coding scheme is inefficient in the sense that the ratio K / E[Nn ] is 
small. This inefficiency is largely due to the fact that an all-zero coded packet can be generated 
and transmitted; this possibility is not precluded in (I3TI) and occurs more often for small values 
of K. The inefficiency of the coding scheme means that the retransmission of K packets requires 
a service time that is less than E[N^] for small values of K. This effect seems to become 
more pronounced as the channel improves, since for a "good" channel, packets are more often 
received correctly and do not need to be retransmitted. 

VIII. Discussion 

One conclusion to draw from our work is that for sufficiently large blocklengths, given by K in 
our model, coding over packets in a queue yields a higher stable multicast throughput than simply 
retransmitting lost packets. In light of the recent developments on network coding and fountain 
codes, this result is not surprising. However, we have also shown that if the blocklength is too 
small and the code is not designed appropriately, then a retransmission scheme can provide 
a higher stable throughput than coding. Furthermore, we have combined random access with 
random linear coding to yield an efficient multicast scheme that can operate in a completely 
distributed manner. We have shown that the merging of random access with random linear coding 
results in good performance in the sense that the stable throughput approaches the Shannon 
capacity. In the process, we have presented a model that represents random coding of packets 
in a queue. 

Another significant outcome of our work is that we have provided an example of a transmission 
policy for which the stable throughput region does not coincide with the Shannon capacity region 
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0.1 0.2 0.3 0.4 0.5 0.6 0.7 



Source 1 rate (packets/slot) 

Fig. 3. Closure of the stable throughput and capacity regions for a channel with reception probabilities — q^l — 0.8, 
= q£X = 0.7, and gj™' 2 = q^i2 = 0.2, m = 1,2. The stable throughput region for random linear coding is abbreviated 
RLC. 

of a random access system. This outcome contradicts a widely-held (yet unproved) belief that 
the stability and capacity regions coincide for random access. This result sheds further light on 
the relation between the stable throughput and the Shannon capacity as representations for the 
rate of reliable communication. 

Appendix I 
Proof of Theorem CD 

Let P^ denote the error probability for the t th message from the sources at receiver m. 

The following lemma provides a condition equivalent to P e * — > and is used in the proof of 
Theorem [TJ 

Lemma 5: The average error P l e — > if and only if max m — > 0. 
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Proof: The average error P* can be upper bounded by the union bound as follows: P* < 
P\ + P\ < 2 max m P^. A similar lower bound also holds, namely P l e > max m P l m . Thus 
max m P^ < P e * < 2 max m P^ and the result follows. ■ 
Achievability for our system is shown by first establishing achievability for the MAC W m . 
This is shown in [11] and [10]; the approach presented in [11] is summarized here. Each 
codeword symbol in the codebook for source n is generated according to the distribution P(x n ), 
independently over codeword symbols and independently over messages. The following two 
properties are assumed. 
(I) The codewords x„(l) and x n (2) are reserved for use as preambles. A preamble is sent after 
every sequence of T messages and x n (l) and x n (2) are used as preambles in an alternating 
fashion. In [11] it is shown that by using the preamble, the receiver can synchronize on 
codeword boundaries with arbitrarily small probability of synchronization error. 
(II) In a sequence of T + 1 messages (including a preamble), no messages are repeated. As a 
result, any two disjoint subsets of N(T + 1) codeword symbols (corresponding to T + 1 
messages) are independent. For T -C 2 NRn the resulting loss in rate is negligible. 
By observing the channel outputs, the decoder <pi m can detect the preambles £i(l) and £i(2) to 
determine that the output symbols in between correspond to inputs xi(jl), Xi(jf ), . . . ,Xi(jf). 
Let xf denote the sequence of N(T + 1) symbols corresponding to Xi(jl), Xi(jf ), . . . ,xi{jT) 
augmented by portions of the preambles £i(l) and £2(2). At the channel output, xf will overlap 
with a sequence x\ consisting of N(T + 1) symbols input by source 2, including N preamble 
symbols. Let ym^ T+1 ^ denote the output sequences corresponding to xf and x\ at destination m. 
The decoder lm outputs the unique sequence of messages j\ m , jf m , . . . , jf m that lies in the set of 
typical (xi, x\, ym^^) sequences. With this approach it is shown in [1 1] that Pr{ J{ ^ J{ m } — » 
for all t. A similar technique can be used by decoder 2m to show that Pr{ J\ ^ Jim} ~^ 0- Then 
by the union bound, P^ — > for all t. Finally, if the rate pair (Pi, P 2 ) lies in the intersection 
of the achievable rates for MACs W\ and W2, then max m P^ — * and thus P* — > for all t 
by Lemma |5l 

The converse for the MAC W m is shown in [11] and [10] by using Fano's inequality, the data 
processing inequality, and the concavity of mutual information. Then max m P^ — > implies 
that the rate pair (Pi,P 2 ) must lie within the intersection of the capacity regions of W\ and 
W 2 . 
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Appendix II 

Markov chain analysis of random linear coding 

In the Markov chain analysis of Section |VI-B[ the state k) represents i linearly indepen- 
dent coded packets received at destination 1, j linearly independent coded packets received at 
destination 2, and k coded packets which have been received at both destinations, k < min(z, j). 
When source 2 is backlogged, the non-zero transition probabilities for source 1 are given as 
follows for i, j — 0, 1, . . . , K. 



(i,j,k) - (i,j,k) :p 1 + Pl [p 2 {(i-g^)(l-giji)+(l-g^)g^2- 

+ gif)(l-^)2^2-- + ^^2 fc 2--} 

+P2{(i-gif 1 ) , 2 )(i-gS, 2 )+(i-g;; i ) , 2 )g;f 1 ) , 2 2^2^' 



+gffi a (l - ?S 2 )2 l 2-^+g 1 ( ! 1 ) nQ ® „2 k 2~ K 



^111,2^111,2^ 



{i + k) : Pl p 2 { g<g(l - qfl){l-T2- K ) + gggg(2 j - 2 fc )2" A ' 



+P2 {g}; ij2 (i - gjjy (1-2*2"*) + g}[ 1>2 g^ 2 (2' - 2*)2 

(i, j + 1, k) : Pl \p 2 {(l - g «)gW (1-V2T K ) + q^q§{? - 2 k )2~ K 



,(2) 



-A' 



+p 2 {(i - Ow 1 "* 2 ) + g}f 1)2 g^ >2 (2 J - 2 fe )2" 

1, j + 1, k + 1) :jn [p 2 {q^lil-i? + 2* - 2 k )2~ K )} 

+^{gffi )2 gS )2 (i-(2 i + tf -2 fc )2" A ) 



(i, HC, fe) - (i, If,*;) [p 2 {O-q^h+q^-x 

(i, A, fc) -> (z + 1, A', fc) : Pl [p 2 {gif 1 ) (l-(2 i + A - fc)2-* 
(2, A, fc) — > (i + l,K,k+ 1) : Pl k {q^(K - k)2~ K \ +p 2 



P2{(i-gi; i)2 )+gi; i , 2 2 i 2-^ 

+P2 { q fl 2 (l-(? + K-k)2- K ) 
q§ 2 {K-k)2- K } 



(kj, k) -> (A, j, fc) p 2 { (i- g ^)+ g {gjy2- il } + P2 { (i-g^, 2 )+g^ i2 2 J 2 



-A 



-A 



(K, j, k) - (A, j+1, fc) : Pl p 2 ^ <z$(l-(* + A - fc)2 



+P2{qfl 2 (l-i2 3 +K~k)2- K ) 
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{K,j, k) - (KJ+l, k+1) :p x [p 2 [q®(K - k)2~ K ] +p 2 [qf^K - k)2~ K ] 
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